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Abstract — signal direction-of-arrival estimation using an array 
of sensors has been tlie subject of intensive research and 
development during the last two decades. Efforts have been 
directed to both, better solutions for the general data model 
and to develop more realistic models. So far, many authors have 
assumed the data to be iid samples of a multivariate statistical 
model. Although this assumption reduces the complexity of the 
model, it may not be true in certain situations where signals 
show temporal correlation. Some results are available on the 
temporally correlated signal model in the literature. The tempo- 
rally correlated stochastic Cramer-Rao bound (CRB) has been 
calculated and an instrumental variable-based method called 
IV-SSF is introduced. Also, it has been shown that temporally 
correlated CRB is lower bounded by the deterministic CRB. In 
this paper, we show that temporally correlated CRB is also upper 
bounded by the stochastic iid CRB. We investigate the effect 
of temporal correlation of the signals on the best achievable 
performance. We also show that the IV-SSF method is not 
efficient and based on an analysis of the CRB, propose a variation 
in the method which boosts its performance. Simulation results 
show the improved performance of the proposed method in terms 
of lower bias and error variance. 

Index Terms — Cramer- Rao bound, temporal correlation, DOA 
estimation, array signal processing. 



I. Introduction 

DIRECTION-of- Arrival estimation using an array of sen- 
sors is widely investigated in the literature in the last 
decades. Many methods are developed for diverse conditions 
(see e.g. [l]-[5]) and their performances are presented via 
simulation results or analytical calculations (for papers on 
theoretical analysis of the performances of the methods see e.g. 
[6]-[9]). Data models play an important role in DOA estima- 
tion. They facilitate theoretical derivations of various solutions 
by their inherent simplistic mathematical and statistical nature. 
At the same time, overseeing many real-world effects may 
result in modelling errors and therefore suboptimal methods 
for the problem at hand. Then, there is a trade-off between 
simplicity of the models and their usefulness in practice. 
In the context of array signal processing, there has been 
considerable research to resolve many aspects of the standard 
model during the last decades. As a parallel line of research, 
there also have been efforts to introduce better models which 
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are more application-specific or sometimes more general than 
the standard model. 

In the standard DOA estimation model, snapshots are as- 
sumed to be iid or uncorrected in time. In practice, iid 
assumption is satisfied with narrowband bandpass filtering of 
the received signal which gives zero time correlation in certain 
time delays as ideal sampling points. However, assuming iid 
snapshots, places a limitation on the applicability of the results 
in the real world and also forces some practical difficulties. 
Assuming perfect bandpass filtering of the signal and exact 
sampling on the zeros of the correlation function, sampling 
rate should be reduced so that the subsequent samples be 
uncorrected. This is a technical difficulty for environments 
with slowly fluctuating signals when we need large number of 
samples. Some maximum likelihood methods require the num- 
ber of observations be at least equal to the number of sensors 
in order to have a full rank sample covariance matrix R [10], 
at the same time many available DOA estimation methods are 
efficient only asymptotically in number of snapshots [6]. Then, 
assuming iid snapshots in theory, results in longer observation 
times which is not always possible due to moving targets, and 
may expose us to unpredicted errors due to modelling error 
Therefore, it seems useful to accommodate time correlation of 
at least signals in the model. 

Recently, there have been some attempts to tackle with this 
problem. In [11], authors consider the performance of the 
spatial covariance-based methods for DOA estimation when 
signal and noise are not guaranteed to be iid. They conclude 
that only if noise is still uncorrelated in time, most methods 
are insensitive to the time correlation of the signals. In [12], 
an instrumental variable approach (IV-SSF) to the direction- 
of-arrival estimation problem in the presence of the time 
correlation of the signals is proposed. The authors improve 
their previously presented method in [13] to obtain a more 
reliable approach. The feature of the IV-SSF is that it does 
not require any knowledge of the noise covariance matrix but 
its uncorrelatedness in time. In [12], authors also present a 
statistical performance evaluation for the IV-SSF and calculate 
some performance bounds for it. In particular, they derive the 
CRB for the general case of temporally correlated signals and 
show that it is lower bounded by the well-known deterministic 
CRB [14]. In another paper in this field [15], authors show 
the asymptotic equivalence of spatial and temporal IV-SSF 
methods in a unified framework. 

In this paper, we study the properties of the temporally 
correlated CRB. Although the effect of temporal correlation 
of the signals on the conventional methods of DOA estimation 
is investigated in [11], an important remaining question is 
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the role of temporal correlation of the signals in the best 
achievable performance. Is it helpful or harmful and how much 
in various conditions? We investigate this issue and show that 
it is helpful particularly in low SNRs. We also show that the 
temporally correlated CRB'^™ is decreasing with the number of 
samples, as we expect. Then we turn to the IV-SSF to show 
that it is not an efficient method of DOA estimation in the 
sense that it cannot achieve the CRB'^°'. Using an asymptotical 
analysis of the CRB'^", we propose an improved version of the 
IV-SSF which can outperform the existing version. At the end, 
simulation results confirm the superiority of the new version in 
terms of lower finite sample bias and estimation error variance. 

The remaining of the paper is organized as follows: Section 
inipresents the data model for the temporally correlated signals 
array processing. Section |lll] is dedicated to the analysis of the 
CRB properties and a number of new results and comparisons. 
In section HV] the optimality of the IV-SSF in comparison with 
the CRB"^"' is investigated and an improvement is proposed. 
In section |V] simulation results are presented to show the 
better performance of the proposed method. Finally, section 
IVTl concludes the paper. 

Notation: 





Kronecker product; 





Hadamard-Schur product; 


Ml 


matrix Frobenious norm; 


(•)* 


conjugate; 


{■? 
i-f 


transpose; 


conjugate transpose; 


Tr(.) 


trace; 


vec(-) 


vectorizing operator; 




real part; 


Sij 


Kronecker delta; 


a{9i) 


array steering vector; 


A 


= \ a(B\)^ . . . , a(9rn)\\ steering matrix: 


D 


= [di, . . . ,dm]; di = da{di)/ddi; 


ni 


I - A{A^A)-'^A^\ orthogonal 




projection on to the null space of A; 


A>B 


A — B is positive semi-definite; 




ij'th block of matrix P; 




ij'th element of matrix P; 


BTr™(P) 


= Ej^mxm; block trace; 


Block.jiP*^] 


a block matrix with blocks T'^-' . 



II. Data Model 

Let an array of L sensors receive n samples of the ambient 
signal and noise. Signal is composed of plane waves from m 
distant point sources with directions 6 = [6i, ...,6'™]. Spatial 
correlation between different sources and temporal correlation 
of the signals are permitted. Noise is assumed to be temporally 
white. Then, received data can be modelled as 

x{t) ^ A{e)s{t) + v{t) (1) 

where s(<)mxi is the sources signals and i'(t)Lxi is the 
sensors noise vector. Data samples are gathered in matrix 
form as X^xn — [^^(ii), ■ • • , 35(t„)], and the same is done 
for the signal sequences S„ixn ~ [^(^1)7 ■ ■ ■ ^ ■s(in)] and noise 
V Lxn = W{ti), ■ ■ ■ ji^itn)]- Using this notation, the model in 



([U can be written as 

X = A{e)S + V. (2) 

Now, we consider the statistical properties of the model. 
Regarding the statistics of the signal, three models can be 
assumed: deterministic, iid, and temporally correlated signal 
models. 

7 ) Deterministic Signal Model: Deterministic signal model 
assumes a constant signal sequence in every realizations of 
the process. Then the statistical model of received data will be 
Gaussian with mean of the signal part and covariance matrix 
due only to noise 

x'^^^t) ^f^{A{e)s{t),C) (3) 
C = E[i.(t)iv"(t)]. (4) 

2) iid Signal Model: In the iid signal model, signal is a 
random process with the same distribution in every snapshots 
and no correlation exists between snapshots. Then, data model 
for the iid case is 

x'^'^it) ^JViO,R) (5) 

where 

R = APA^ + C (6) 

and 

P = E[s(i)s«(t)]. (7) 

3) Correlated Signal Model: In the correlated signal model, 
noise samples are still assumed to be spatially correlated, 
distributed as a zero-mean Gaussian random vector i'{t) ~ 
Af{0, C), and temporally uncorrelated with E[i/{ti)i/^{tj)] = 
, i ^ j. Then, a space-time distribution for noise can be 
defined as 

vec(V) ~ A/'CO, C) (8) 
C = 7„ ® C. (9) 

Similarly, a space-time covariance can be defined for signals. 

Let V'^ =E[s{ti)s^{t^)], then 

vec(5"°'-) -A/'(0,7') (10) 

where Vnmxnm = Blockij[7'^xm]- Now, the space-time 
distribution of the data under correlated signal model can be 
easily shown to be 

vec(X"°0 -A/■(0,7^) (11) 

where 

n = AVA^ + C (12) 

and 

A=In(^Aie). (13) 

Note that (fTSl i has a structure similar to the iid case (|6]l. It 
is also assumed that m < L and that the array manifold 
has the property that every set of distinct steering vectors 
{a{9i),--- ,a{6L)} forms a linearly independent set. Also, 
a{9) is assumed to be a smooth function as it is in real 
applications which means that d{9) exists. These assumptions 
pave the way for the estimation problem at hand to be 
identifiable. 
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III. Analysis of the CRB 

In this section, we present new results and analyzes on 
the temporally correlated CRB to give more insight on the 
estimation problem. We are specially interested in the role of 
temporal correlation of the signals in the direction estimation 
problem in comparison with the uncorrected signal case or 
iid signals. 

CRB is a lower bound on the performance of any unbiased 
estimation method in terms of error variance. Consider a 
random vector distributed as y{t) ^ f{ip)^ where ip is the 
vector of possibly unknown parameters of the distribution. 
Given samples of y{t), an unbiased estimator ip satisfies 
E[ip] = ip and its error variance is lower bounded by the 
CRB as 

E[{rP - i,){ip - > CRB^.^. (14) 

CRB is an inherent property of the statistical model of the 
data and can be calculated directly from The impor- 

tance of the CRB also comes from the fact that there exist 
estimators that at least asymptotically attain the CRB such 
as the maximum likelihood estimator. In the following, CRB 
for three discussed signal models are repeated for the sake of 
reference. In the deterministic signal model of ^ and (|4|i we 
have [14] 



then the CRB"" can be written as 



where 



1 

2n 



C 5 A 

In the iid model of © and © the CRB""* is [14], [16] 

1 r. 



(15) 
(16) 



2n 





q{pa^r-^ap) 



(17) 



and in the temporally correlated signal model of (fTTT i. (fT2l i. 
and (O the CRB"" is [12, eq. 112] 



where 



0BTr„(pg« n'^^grf 
7^' = gvg^ + 1 = c^^ nc'^ . 



(18) 

(19) 
(20) 



where X = J„ J^. It is noteworthy that the expression of 
the CRB"" in [12] is slightly different from ^ in that it 
contains a factor of — in the right-hand-side. This is a direct 
consequence of the difference in the definition of the CRB 
between ( fT4l ) and what is in [12]. As a confirmation for the 
form of CRB"" in ( fTSl l, consider the case of iid signals where 
the space-time matrices turn out to be block-diagonal, then a 
factor of — appears in the right-hand-side to reduce the CRB"™ 
in (O to'\he CRB""* in (O. 

To proceed further, we first give a simplified form of the 
CRB"" in (HI. Note that 



w^g = A"" n-^A 



QBTir„{VA^ ■R-^AV)'^ 



(22) 



Now, we are ready to state our first result on the comparison 
of the CRB in the signal models introduced. 

Theorem 1: For the deterministic signal model in ([3]) and 
(IDl, iid signal model in Q and (|6|l, and the temporally 
correlated signal model in ( fTTT l and ( fT2] l. CRB"" is upper 
bounded by CRB"'' and lower bounded by CRB'^"' 

CRB"*"' < CRB"" < CRB"'*. (23) 
Proof: The left side inequality is proved in [12], therefore 
we give a proof for the right side inequality. We make use of 
a form of the Woodburry identity [17], [18] which states that 



{A + BCD)-^ 



A^B{I + CDA-^B)-^CDA-^ 



(24) 



which is essentially another form of the matrix inversion 
lemma. Now we expand the space-time matrix in the block 
trace of ( |22] | substituting from ( fT2] i and making use of ( l24b to 
have 

VA}^ n-^Av = VA^[C-^ - 
C-^A[T + VA'^C-^A)-^ V^C~^]AV = 
VA^C-^AV - VA^C-^A{X + 

VA^C-^Ay^VA^C-^AV. (25) 

We factor the common terms of ( |25] ) from right side to get 

[T-VA^C-^A{T + 

VA^C-^Ay^]TA^C-^AV. (26) 

Add and subtract an X to the VA^C^^A in the bracket in 
to get 



(X + VA^C^^Ay^VA^C^^AV. 



(27) 



Do the same for the term outside the bracket in ( |27] i in the 
following form 



{I + VA^C-^Ay^{T + VA}^C-^A-T)V. 



(28) 



As a useful result, we arrive to the following equality simpli- 
fying 



A^'C-^A) 



(29) 



Note that the matrix in parenthesis is positive semi-definite, 
then we will have 



VA^Tl^AV < V 



(30) 



(21) 



which is another proof for the left side inequality in ( |23] ) (see 
[12]). Now, we proceed to prove the right side inequality in 
(|23l). define 

T'd -Block„ [P^^%] (31) 

which is the block-diagonalized version of the signal space- 
time covariance matrix. Note that block-diagonal space-time 
covariance matrix for signals Vd, represents the temporally 
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uncorrelated signal model (more general than iid signal 
model), while V represents the temporally correlated signal 
model. Now, assume a matrix T and its block-diagonalized 
version T d- It is well known that 

> = {r'^y^ = [T-^y\ (32) 

Using the inequaUty in (|32] |. besides the fact that J^C^^ A. 
is block-diagonal, we will have 

A^C-^A- {Vd + {A^'e-^AyY' (33) 

Now, we multiply B = {A^C^^Ay^ from right and left of 
both sides of the inequality to get 

B-B{V + By^B<B-B{Vd + By^B. (34) 

The above expressions can be simplified using matrix inversion 
lemma to give 

{T-yA''C-^Ay' < {T^yA''C-^Ay\ (35) 

Applying the block trace operator and adding a common term 
results in 

BTr™[p-(p-i+^«C-U)"'] > 

BTr„, [Vd - {V;y + ^"C-U)"'] . (36) 
According to ( |29] l, the inequality in ( |36] | implies that 

mXraiVA^-R-^AV] > 

BTr„[PM"7^^UPd]. (37) 
which in fact completes the proof of (|23] | showing that 

CRB™"'(7') < CRB™'(-Pd)- (38) 

□ 

The upper bound and lower bound on the CRB'^" presented 
in (l23T l is very insightful to the estimation problem at hand. 
It implies that the existence of a temporal correlation in the 
signals improve the best attainable performance of estimation. 
The comparison made in theorem [T] is conditioned on the 
specific spatial covariance matrix of the sources in each 
sample i.e. with the same diagonal blocks of the space-time 
signal covariance matrix. It shows that adding a nondiagonal 
covariance block improves the performance since it simplifies 
the extraction of the signal part from received data. Most 
spatial covariance-based DOA estimation methods rely on 
the different spatial characteristics of the signal and noise 
(signals are point sources of radiation while noise is uniformly 
distributed in the space or at least is spread via large areas). 
This is not the case in the temporally correlated signal model 
where there is a particular difference between signal and noise 
in that one is temporally correlated and the other is temporally 
uncorrelated. This increased distance of the signal model and 
noise model improves the CRB and the performance of the 
methods using it. As a result, we can see that the CRB"^"' 
is lower than the CRB'"^ which implies better performance 
when noise and signal have different temporal characteristics. 
Another explanation for the inequalities presented in (|23] i 
comes from the degree of predictability of the signal. It is 



obvious that in the deterministic signal model we have a sta- 
tistically constant signal which is fully predictable. Therefore, 
the performance is best in the deterministic signal model. In 
the correlated signal model, signals are stochastic in nature 
and vary in each realization, which makes the signals less 
predictable. Though, the existence of the temporal correlation 
of the signals offers a limited possibility for coarse signal 
prediction and extraction from noise which places the CRB"^"' 
lower than the completely uncorrelated case of CRB'"'. 

Although we have confined the CRB™' between CRB'''=' and 
CRB'"* in theorem[ri we are interested to more exactly specify 
the behavior of the CRB"^"' in different situations. This helps 
us to get more insight to the role of temporal correlation 
of the signals in DOA estimation. Therefore we consider 
approximations of the CRB'^" in different situations in temrs 
of signal to noise ratio (SNR) in the following theorem. 

Theorem 2: In the high SNR condition, temporal correla- 
tion of the signals makes no improvement on the uncorrelated 
signal model while in the low SNR condition, the contribution 
of zero-lag and nonzero-lag covariances are the same, i.e. 
nonzero-lag covariances improve the CRB. 

SNR > 1 : CRB"°' - CRB'''' (39) 
SNR < 1 : CRB"^™ < CRB"'' (40) 
Proof: Consider the high SNR condition. We make 
use of the following easily checked approximation for any 
appropriately sized matrices B and A if ||A|| < ||B|| 

B^AB ys^AB^AB^ (41) 

Now we can expand the block trace in CRB*^"' as follows 

BTT^[VA^n-^Ar] = 

BTr„, [PA^{C + ATA^y^AT]. (42) 

We use matrix inversion lemma for the inverse in the block 
trace of (l42T i to get 

BTr,„[-pA"(C"^ - C'^AiV'^ + 

A^C-^Ay^A''e-^)AV]. (43) 

Now we use the approximation in dTTT l up to the third term. 
Note that the high SNR assumption guarantees that HP '^[j < 
II^^C^'^^II. After some calculations we get 

BTr,„[7'^"7?.-U7'] ~ 

BTr™[7'-(A"C-U)-^] (44) 

in the high SNR region and to the second order of ap- 
proximation. The approximation in (|44] | asserts that in high 
SNR condition, only block trace of the signal space-time 
covariance matrix contribute to the Cramer-Rao bound, hence 
we can conclude that in this case, the temporal correlation 
of the signals (represented by nondiagonal blocks of P), do 
not improve the best achievable performance of the DOA 
estimation and (|39] l follows. 
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In the very low SNR region, we use the approximation 7?. : 
C. Then expanding the block trace in the CRB gives 



BTr™ [VA^n-^AV] 



J2{AV"fC-\Ar"). 



(45) 



We can see from (|45l l that every blocks of V contribute 
the same to the CRB'^™ in the situation of very low SNR. 
Since each term in the summation of (l45T l is positive semi- 
definite, then each nondiagonal block of V improves the 
CRB"^"' making the distance from CRB'"* larger which implies 
( |40] l. It is noteworthy that improvement of the CRB does not 
mean the performance improvement of the conventional DOA 
estimation methods, rather it clarifies the existence of methods 
that can achieve better performances through making use of 
the temporal characteristics of the signals and noise. □ 

Now, after we considered the role of the temporal correla- 
tion of the signals in the best achievable performance of DOA 
estimation, we turn to an assumed characteristic of the CRB. 
The CRB usually decreases with increased amount of data. 
This is obvious in the iid signal models where the CRB for n 
data samples is ^ of the CRB for one sample. Though, this 
is not very clear for the temporally correlated signal model 
where the dependence of the CRB'^°'^ on n is embedded in the 
size of the space-time matrices. 

Theorem 3: CRB'^" is decreasing with increasing n. 

CRB'°\n + 1) < CRB™'"(n). (46) 
Proof: Applying matrix inversion lemma, we can show 



that 



A'^n-^A ={r + (A^'c-^A)-^) 



(47) 



Assuming Vn+i as the block-diagonally augmented version 
of Vn and using ( l47T i. we will have 



CRB" 



Vn 



ri+1 



< CRB^'XP,, 



(48) 



smce 



BTrm[7'„+l^^^j^ TZ-.^^lAn+lTn+l] — 

BTr,„[P„(7'„ + iA^C-^An)-')-^Vn] 4 

p„+i(p„+i + {A^'c-'Ay^'p 



n+l 



(49) 



and the second term is positive semi-definite. Following the 
same steps as in ( l33T l to ( l38T l, we can also show the following 
inequality which completes the proof. 



CRB' 



Vn 

Q 



Pn+l 



< CRB" 



n+l 



(50) 



Note that, ( fSOl l is a generalization of the R.H.S. inequality in 

□ 

In this section, we investigated the general properties of 
the direction-of-arrival estimation problem in the presence 
of the temporally correlated signals. We performed this via 
Cramer-Rao bound analysis and characterization. In the next 
section we turn to the practical methods to accomplish DOA 
estimation under temporally correlated signal model. 



IV. SUBOPTIMALITY OF THE IV-SSF METHOD 

We have considered the best achievable performance in the 
temporally correlated signal model. In particular, we found that 
it is possible to improve the performance of the conventional 
spatial covariance-based methods by devising new methods 
that can exploit the temporal correlation of the signals. How- 
ever, the CRB'^" has been calculated under the assumption 
of known noise spatial covariance matrix. When this is not 
true, we do not expect any method to reach the CRB"^"' 
in performance. In the situation of unknown noise spatial 
covariance matrix, the instrumental variable subspace fitting 
(IV-SSF) method for direction-of-arrival estimation has been 
proposed in [12]. The method is based on the instrumental 
variable approach. It makes an instrumental variables vector 
(p{t) for each data sample x{t) in such a way that the cross- 
covariance of 4>{t) and x{t) does not contain the unknown 
noise covariance matrix. Then, a sample cross-covariance can 
be used to extract the signal subspace and parameters of 
interest. Note that the signal temporal correlation leave a room 
for the multiplication of noncontemporary data to contain 
information about the directions of arrival. The instrumental 
variables vector for each data sample x{t) is formed as 



x{t - M) 



(51) 



where M is a user defined integer determining the degree 
of complexity and hence the performance of the method. In 
general, larger M should result in better estimates, although 
simulation results show increased bias and decreased error 
variance when M becomes larger. Let the cross-covariance 
of the signals at time lag k be defined as 



Pk = E[s{t - 
and define for convenience 

" Pi 

^ = \ 
Pm 



(52) 



(53) 



then the cross-covariance of the received data and the corre- 
sponding instrumental variable will be 



S ^ E[0(t)a;"(t)] = (Jm ® A) JA^ 



(54) 



which is independent of the unknown noise spatial covariance 
matrix C. Also define the instrumental variable covariance 
matrix as 

*^E[0(t)0»(t)]. (55) 

The estimates of the DOAs in IV-SSF method are obtained in 
the following steps: choose M > 1 and compute the sample 
estimates 

1 



S = 



t=M+l 



1 



n~ M 



(56) 



(57) 



t=M+l 
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Next, extract Rq from as one of the m x m diagonal 
blocks. The estimates of the parameters are the minimizer of 
the following criterion function: 



e = arg min Tr (tl^Ro ' Vs^Iv^Rq ' ) (58) 



where 



n; 



(59) 



and Vs contains the dominant right singular vectors of the ma- 
trix ^ ^ S, while the associated singular values are gathered 
in matrix ^s- 

Using the IV-SSF method, the asymptotic error covariance 
matrix has been shown to be [12] 

-1 



Cov 



IV-SSF 



2n 



(60) 



in which Am — I m (E) A. The covariance in (|60] | is slightly 
different from the CRB''" in We aim to show that the 
IV-SSF method with above error covariance does not attain 
the CRB'^" asymptotically and relying on this analysis, we 
propose a variation in the method to boost its performance. 
To this end, we use an asymptotic analysis presented in [12] 
with some modifications to be able to compare the CRB"^"' and 
the covariance in (l60l l. Define an estimation problem in which 
we are interested to estimate the signal s{t) using the data 
z{t) = s{t) +w{t), in which w{t) is a temporally white noise 
term with spatial covariance matrix {A^C^^ A)^^ . Note that 
w{t) is temporally white since it is constructed from iid noise 
term v{t) by a linear transform in the space domain. Assume 
that we are to estimate s{t) from M previous samples of z{t) 



z'^(t - M) ' 



(61) 



with the best linear transform which minimizes the error 
covariance matrix. The estimation error will be 



s{t)-l-LzM{t)^e{t) 



(62) 



where T-L is the best linear transform in the least squares sense. 
Making use of the orthogonality principle, we can show that 



n = j'^{Vm + {aIiCiIa_ 



■M) 



(63) 



where Vm is the space-time covariance matrix of the signals 
in M snapshots and Cm — I m ® C. The resulting minimized 
error covariance matrix will be 

Se = Po - J'^iVM + {AliCl^AMr^y^J (64) 

which along with a readily shown result similar to (|47] | reduces 
the second part of the error covariance matrix of IV-SSF 
method in (|60l l to 



J^'A^I.^-'AmJ = J''{V 



'M 



{A^IiCiIAmT^) (65) 

The error covariance matrix in ( |65l l has the implication that 
the minimum attainable error covariance in the IV-SSF method 
depends on the minimum error of prediction of the process 



s{t) in the noise term w{t) using M previous samples of 
the data z{t). Lowering the prediction error will cause the 
error covariance of IV-SSF in (|60] l to reduce. Now we use 
an asymptotic analysis on the CRB'^" to reform it in a form 
similar to ( l65T l which enables us to understand why IV-SSF 
method does not reach the CRB'^™ and propose a modification 
in the method to improve its performance. Assume that large 
number of data is available n +oo. The block trace in the 
CRB''™ in ^ can be written as 



(66) 



where P'' and P * denote the i'th block row and column 
of 'P, respectively. We assume a stationary signal model in 
this section which results in a block Toeplitz signal space- 
time covariance P. Further, we assume a regular signal 
random process in which the cross-covariance decreases with 
increasing time lag. For such asymptotic conditions we can see 
that block rows 7-"' are shifted versions of each other, ignoring 
the first and last ones. The same is true for block columns P ' 
and also for the matrix 7?.~^ and hence ^ TZ^A i e- block 
rows (and columns) of these matrices are shifted versions of 
each other. This special matrix multiplication form ensures 
that the terms in summation in (l66T l are approximately equal. 
Then, (|66] | can be reduced to 



BTvrn[VA^ n^^AV] ~ nV'^A^ W^AV' 



where 



T' = [ 



pT pT pT 

-1 -^0 -^ + 1 



(67) 



(68) 



Now, using a similar analysis as in ( IMT l to ( |65] l with a data 
vector defined as 



Zcrb{t) 



■z'^{t-l) z'^it) + 



(69) 



results in an approximation similar to 
of the CRB™' 

V'A^n^AV = Pq 



for the second part 



(70) 



in which, is the error covariance of the smoothing of 
the random process z{t), i.e. estimating the signal part s{t) 
from the data described in i6% . Now, after that we have 
transformed the matrix forms of the CRB*^"' and the error 
of the IV-SSF method to the same formats, it is possible to 
see that the IV-SSF method won't attain the CRB™' since 
< Se. Obviously, it is easier and results in lower error 
to estimate the signal s{t) using Zcrb{t) in (|69] l rather than 
using ZM{t) in (1611 1 because of larger amount of correlated 
data available. Using this analysis, we can understand what is 
required to improve the performance of the IV-SSF method. 
The key observation is that the structure of the estimation 
problem and Zi\j{t) is similar to the structure of the <p{t), the 
instrumental variable chosen for the IV-SSF. It shows that we 
could achieve the best performance if we could have defined 
an instrumental variable containing all data before and after 
the present signal s{t). Though, we can't include x{t) in the 
instrumental variables since it requires the knowledge of the 
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Fig. 1 . An example of the CRB versus the number of snapshots in logarithmic 
scale for two sources. The temporally coiTelated CRB is upper bounded by 
the iid CRB and lower bounded by the deterministic CRB. 



Fig. 2. An example of the CRB versus the SNR in logarithmic scale for 
two sources. The temporally correlated CRB tends to the iid CRB as SNR 
increases. 



noise covariance matrix. Also, the limited degree of complex- 
ity we afford for our method don't permit the inclusion of 
too many instrumental variables. We are free to choose M 
instrumental variables and we propose the following 



(71) 



x{t+l) 
x{t-l) 

In the subsequent section, we will present simulation results 
which confirm the improvement in the performance of the IV- 
SSF method using the above two-sided instrumental variables. 

V. Simulation Results 

In this section, we illustrate the CRB"^"' and the performance 
of the two methods investigated: the IV-SSF method and 
our proposed method which we call two-sided IV-SSF. We 
also present simulation results that confirm the inequality in 
theorem [T] Performance of the methods is considered in the 
sense of error variance and bias. Although the IV-SSF method 
shows to be asymptotically (n +oo) unbiased and this is 
shown theoretically in [12], in the nonasymptotic region of 
limited available data, it shows strong bias. We will see that 
the two-sided IV-SSF outperforms IV-SSF in both lower bias 
and lower error variance. 

We first present some graphs on the Cramer-Rao bounds. 
The main result we provided on the CRBs is the inequality 
in ( l23T l. We also showed that the temporally correlated CRB 
is decreasing with the number of snapshots n. These facts are 
presented via an example of two-source scenario in Fig. [T] 
Conditions of the simulation are as follows: two sources at 
angles [0 0.2] radians with respect to the array broadside are 
present. Array number of elements is 3 with A/ 2 spacing and 
SNR=10 dB. Uniform linear array is assumed and the signal 




CRB'=°' / CRB''" 

- - CRB'"'' / CRB"" 



10 



15 



20 



Fig. 3. The comparison of the temporally coirelated CRB and deterministic 
CRB normalized to the iid CRB. The comparison shows the equivalence of 
the iid and temporally correlated CRBs when SNR is high enough. 



covariance matrix is defined as 



(72) 



where [Pt],, = e-0-2|»-j|, [p^]^^. ^ e-'>■5\^-J\^ ^nd = 
^2g-|j-j| Pig [X] shows the decreasing CRB versus increasing 
n, it also confirms the inequality in (l23T l for this special case. 
It is also noteworthy that the difference between three types 
of CRBs increases with n since with increased number of 
snapshots, there are more room for the temporal correlation 
to improve the DOA estimation performance. In Fig. |2] CRBs 
are depicted versus SNR. It can be seen that as SNR increases, 
three types of CRB merge together and decrease linearly. 
Though, the CRB™' joins the CRB""* faster than CRB'^"'. This 
is better shown in Fig. |3] where the CRBs are normalized to 
the CRB'"^ to confirm the result of theorem |2] which is stated 
in 

Now, we present simulation results which support the pro- 
posed method versus the main IV-SSF. In the simulations, 
single source located in w = 2ttj cos{9) — 0.8 is assumed, 
with a four-element half-wavelength array, number of instru- 
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Fig. 4. Bias and standard deviation of one- and two-sided IV-SSF methods 
versus n. It is clear tiiat tlie two-sided IV-SSF outperforms the one-sided one 
in both lower bias and lower standard deviation. The improvement is rather 
constant with n. Asymptotically in large n, bias is negUgible in the overall 
mean square enor. 



mental variables M = 2, and number of trials 10000. In Fig. 
m performance measures, bias and standard deviation of the 
estimate of uj are presented versus the number of snapshots 
n, while SNR=0 dB is constant. Signal temporal correlation 
is simulated via filtering an iid random sequence with an FIR 
filter with relative tap weights 

' 0.2z-3 + 0.1z"^ 



Fig. 5. Bias and standard deviation of one- and two-sided IV-SSF methods 
versus the SNR. The improvement made by two-sided IV-SSF is larger in 
lower SNRs. In high SNRs, bias is negligible in the overall error 



1 + 0.5^" 



0.3z- 



(73) 



which is then normalized to give a unit-energy filter The 
estimates are calculated using a two step grid search, first a 
coarse search with grid size 0.01 and then a finer one with 
grid size 0.001. Fig. |4] shows the bias and standard deviation 
of both methods versus n. Although bias is relatively small, it 
cannot be neglected in small numbers of snapshots. Although 
the CRB'^" in ( |22] ) has been calculated assuming zero bias, it 
is still rewarding to compare the performance of the methods 
to the square root of the CRB'^", which is depicted in Fig. |4] 
Here, we used f{z) in (iTJt to compute the signal space-time 
covariance matrix P. The improvement made by the two-sided 
IV-SSF is rather constant with n specially in the standard 
deviation. It is clear that the two-sided IV-SSF had made 
roughly 20% improvement in the standard deviation and bias 
without increasing the computational load of the algorithm. 

In Fig. m the same comparison is made with constant 
n = 100 and varying SNR. Obviously, the improvement made 
by two-sided IV-SSF is greater in lower SNR. In high SNR 
conditions, bias is rather negligible in both methods, while the 
improvement percentage is nearly constant with SNR. Finally 
in Fig. |6l the comparison is made in constant n — 100 and 
SNR=0 dB, while M is changed to see the effect of the 
method complexity indicator or the number of instrumental 
variables on the bias and standard deviation of both methods. 
The interesting point is that in low AI, there is considerable 
improvement from one-sided to two-sided IV-SSF. But this 
improvement decreases as M increases since for large M, 
there is enough previous samples to estimate the present signal 
of interest with sufficient accuracy comparable to the accuracy 



Bias IV-SSF 1 sided 
Bias iV-SSF 2 sided 
STD IV-SSF 1 sided 
STD IV-SSF 2 sided 
CRB"' 




Fig. 6. Bias and standard deviation of one- and two-sided IV-SSF methods 
versus the number of instrumental variables M. The improvement made by 
two sided IV-SSF in standard deviation is larger in low M. Also, bias grows 
with M and finally gets larger than standard deviation for large M. 



that can be achieved using the two-sided estimation. Another 
important point of the Fig. |6]is the increasing relative part of 
the bias in the overall mean square error of the estimation with 
increasing M. This phenomena can lead us to limit the number 
of instrumental variables so as to avoid large unpredictable 
bias. This selection can be more rational when we consider 
the increased cost of implementation when M gets larger It 
is also evident in Fig. |6] that the CRB™"^ is independent of M 
and gradually, with increasing M, the portion of error caused 
by standard deviation decreases while the error caused by bias 
increases. 

VI. Conclusion 

In this paper, we presented new theoretical results on the 
performance of the DOA estimation when signals of interest 
are possibly temporally correlated. In particular, it was shown 
that the Cramer-Rao bound in the temporally correlated signal 
model is upper bounded by the same bound under the iid 
signal model. This result implies that temporal correlation 
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of the signals is an additional relevant information for DOA 
estimation. We showed that the improvement caused by signal 
temporal correlation is large when SNR is low and little 
when SNR is high. This is a good news since the high SNR 
condition is not critical in our systems where we can use 
many suboptimal methods; while the low SNR performance 
improvement is valuable to the system. The second part of the 
paper was devoted to a practical method of DOA estimation 
in the new signal model. The IV-SSF method was analyzed 
and compared with the CRB'^'" to show that it is not an 
efficient method. Then, using a special form of the CRB'^°', 
we proposed a version of the IV-SSF method (two-sided IV- 
SSF), that outperform the former method in both lower bias 
and lower error variance. 
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